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Abstract 

We observe two sequences of curves which are connected via an integral operator. Our model 
O I includes linear models as well as autoregressive models in Hilbert spaces. We wish to test the 

null hypothesis that the operator did not change during the observation period. Our method 
■ is based on projecting the observations onto a suitably chosen finite dimensional space. The 

pL| , testing procedure is based on functionals of the weighted residuals of the projections. Since 
the quadratic form is based on estimating the long-term covariance matrix of the residuals, 
we also provide some results on Bartlett-type estimators. 
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: 1 Introduction 

> 



in 



X 



Suppose {X„(t), n = 1, 2, ... , N} and {Yn(t), n = 1,2, ... , N} are sequences of random 



^ ■ functions on [0, 1] that satisfy the linear relationship 

in 

O ■ Y4t) 



[ ^nis,t)Xn{s)ds + en{t). {1.1] 

Jo 



For example, A„(t) and Yn{t) may be the exchange rates of two currencies on day n at 
time t, where the trading day is normalized so that t ranges between and 1. In other 
applications, Xn can be the temperature and Yn the pollution level at a given location. If 
= \E'2 = ■ ■ ■ = \l/7v, we say that the model is stable. However, as the underlying conditions 
change, the \I^'s may also change. Our estimates for the assumed common \l/ as well as our 
predictions and inferences based on the model would be fiawed if we falsely assume that the 
\l/'s have not changed. To test the applicability of this model with an unchanging we will 
test the null hypothesis, 

Ho:^i = ^2 = --- = ^N, (1.2) 

against the alternative 

Ha: ^1 = ^2 = . . . = ^fc* 7^ = ... = ^kf^ "^kf+i = ... = ^N 

with some unknown integers k\, . . .k*. The A;*'s are called change-points, and the alternative. 
Ha, is that there are exactly r change-points. We assume that (II. ip and Hq hold and that 
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both {Xn} and {e„} are stationary sequences. The model with non-changing (stable) \Ef has 
received considerable attention in the literature. If X„ and e„ are independent sequences 
of independent processes, then fll.ip is a functional version of the classical linear model (cf. 
Cardot et al (2003), Chiou et al (2004), Cai and Hall (2006) and Ferraty and Vieu (2006)). 
If Xn = Yn-i, then we have the functional AR(1) model in (11. ip (cf. Bosq (2000), Kargin 
and Onatsky (2008) and Horvath et al (2010)). Aue et al (2011) investigated the stability of 
high-frequency portfolio betas in the capital asset pricing model (CAPM). CAPM is a version 
of the model in fll.ip where, in our notation, a vector valued Yn is a linear combination of 
vector valued X„'s and an additional error term. 

Let C{s,t) = var (X„(t),X„(s)) and D{s,t) = var (F„(t), F„(s)). Let {{vj{s),Xj), 1 < 
j < oo} and {{wi{t),Ti), 1 < i < oo} be eigenf unction-eigenvalue pairs associated with 
C{s,t) and D{s,t) respectively. This means that TiWi{t) = D{t,s)wi{s)ds and XjVj{s) = 
C{s,t)vj{t)dt. Assume that Xj is the j*'^ largest eigenvalue of C{s,t) and that Xj is the 
jth \Q;j-gQgi eigenvalue of D{s,t). It can be assumed that the eigenfunctions of C{s,t) are 
orthonormal and also that the eigenfunctions of D{s,t) are orthonormal. We assume that 
\E' G L^[0, 1]^ and can therefore be expressed as 



oo oo 



= 5Z5^V^M^i(^HW• 
^=l j=l 



[1.3) 



Using f ll.3p we can write the model (II. ip as 



^„(s,t)X„(s)rfs + e„(t) 



X oo oo 



^^ipi,jU;i{t)vj{s)Xnis)ds + e„(t) 
i=i j=i 

i=l , = 1 "^0 



:i.4) 



where 



g oo „i oo oo „ 

i=l j=p+l "'O i=q+l 3=1 "^^ 



ipi,jWi{t) I Vj{s)Xnis)ds. 





Equation (11. 4p means that we keep the parts of Yn and Xn which are explained by the first q 
and p principle components. 



To reduce the dimensionality of the model we will project both sides of (11. 4p onto the space 
spanned by the functions {wi{t), I < i < q}. Doing this we obtain the linear model 



f{Yn,W,)\ 

(Yn, W2) 

\{Yn,Wg)J 



( ^1,1 ^1,2 • • • 
V^2,l ^^2,2 • • • V'2,p 



({Xn,Vi)\ 
{Xn,V2) 



yPq,l ^q,2 ■■■ i'q,pl \{Xn,Vp)J 



e*n,W2) 



:i.5) 
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Instead of testing the null hypothesis, (11. 2p . exactly as it is stated, we would like to test 
if the coefficients {ipij, 1 < * < Q', 1 < J < p} remained constant during the observation 
period. Essentially, we are testing the stability of over the space spanned by the most 

important principle components of the X^s and the Y^s. Equation (11. 5p has the form of a 
linear model, but it is not a classical linear model because the regressors are random variables 
and are correlated with the errors. Unfortunately, we cannot use (II. 5p directly, since the 
covariance functions, D{s,t) and C{s,t), and hence the eigenfunctions, {wi{t), i = 1,2, . . . q} 
and {vj{t), j = 1,2, ... ,p}, are unknown. Instead, we will use the estimates D]\;{s,t) and 
Ci\i{s,t) and their corresponding eigenfunctions, {wi^i\i{t), i = 1,2, ...g} and {vj^N{s), j = 
1, 2, . . . ,p}, where 



DN{s,t) = ^f2^Y,it)-Y^mYk{s)-Y^{s)) with F^(t) = 1 ^ 

k=l i=l 
N N 

CN{s,t) = -J2iMt)-XN{t)){Xk{s)-XN{s)) With Xr,{t) = -J2Mt)- 



k=l 



1=1 



Eigenfunctions corresponding to unique eigenvalues are uniquely determined up to signs. For 
this reason, we cannot expect more than to have Wi^N be close to di^^Wi and Vj^n be close to 
Cj^NVj, where di^N, Ci^N are random signs (cf. Theorem 15. 2p . In order to obtain a linear model 
similar to equation (II. 5p that is useable, we must use our estimates for the eigenfunctions. 
We replace equation (ll.4p with 



q p 



i=l j=l 







;i.6) 



where 



i=l j=p+l i=q+l j = l 



i'i,jUJi{t) / Vj{s)Xn{s)ds 



g p pi 1 P pi 

- di,N'ipi,jCj^N'Wi,N{t) / Vj^N{s)Xn{s)ds + YYllJijWi{t) / Vj{s)Xn{s)ds. 

i=l j=l i=l j=l 

By projecting both sides of (II. 6p onto the space spanned by the functions {wj^is[{t), 1 < j < q}, 
we can replace the linear model (II. 5p with the empirical linear model 



({Yn,Wi^N)\ fdl^Ni^l^Ci^N dl,N^l,2C2,N ■■■ dl,N'ipl,pCp,N\ 
{Yn, W2,n) d2,N^2,lCi^N d2,N^2,2C2,N ■ ■ ■ d2,N'ip2,pCp,N 



( {Xn,Vi^N)\ 
{Xn,V2,N) 



\{yn,KN)J \dq,Ni^q ,lCl,Ar dq^Mi'g,2C2,N ■■■ dq^Ni^g^pCp^N / \(-^n, ^^p,Ar)/ 

( (Oi,iv)\ 



;i-7) 



+ 
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The signs {di^^, 1 < i < q} and {cj^^, 1 < j < p} are computed from Xi, X2, ■ . . , Xj^ 
and Yi,Y2, . . . , Yat and they will not change during the testing procedure. Therefore, testing 
the stability of {di^N'^^ijCj^N, 1 < i < q', 1 < j < p} is equivalent to testing the stability of 
{^ij, I <i < qA < 3 <P}- 



Letting (g) be the Kronecker product, we can express equation (11.71) in a more condensed form: 

Y{n) = Z{n)f3 + A{n), l<n<N, (1.8) 



where 



Yin) 



/3 



{Yn, W2,n) 



/ C?l,Ar^l,lCl,Af\ 
\dq,N'ipq,pCp,N / 



A(n) 



vec{{di^NipijCj^N, I <i < qA < J 



and 



Z{n) = Ig0 M{n) with M{n) = ((X„, v-^^n), 
The least squares estimator for f3 is defined by 

-1 



• 5 {^n, Vp^n)) 



/3 



N 



N^N ] Z^Ytv, 



where the vectors Y^Artj and the matrices Z^Artj for each t G [0, 1] are defined by 



vm 



( Y(l) \ 
Y(2) 

VY(LiVtJ)y 



and Z 



\Nt\ 



I z(i) \ 

Z(2) 

\z{\xt\)] 



Our testing procedure is based on the cumulative sums process of the weighted residuals. 



vm 



N 



^ Z^(n)Y(n) - t J2 Z^HYl 



n=l 



n=l 



, te[0,i], 



;i.9) 



where Y(n) = Y(n) — Z{n)^]^, 1 < n < N stands for the residuals. 
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2 Main Results 



In this section we formally state all of the assumptions that we need and then we state our 
main theorem. Throughout this paper we use | • | to mean the absolute value of a scalar or the 
largest of the absolute values of the elements of a vector or matrix. It will always be clear 
from the context which is meant. 

Our first condition means that the processes Xn and e„ are Bernoulli shifts: 

Assumption 2.1. and en{t) can be expressed as 

Xn{t)=a{r]^{t),r)^^^(t),...) and e„(t) = 6(T7„(t), T;„_i(t), . . . ), 

for some junctionals a andb where {rjf., — oo < k < 00} are iid vector-valued random functions. 

Assumption 12.11 implies immediately that the vector- valued process (A^n,6jj), 1 ^ Ti < 00 is 
stationary and ergodic. If Hq holds, then (X„,e„,y„),l < n < 00 is also stationary and 
ergodic. We also require that the processes have at least 4 moments: 

Assumption 2.2. 

EXnit) = and ^e„(t) = 0, (2.1) 



[ EX^{t)dt < 00 and [ Etl{t)dt < 00. (2.2) 



Assumption 2.3. X„(t) and e„(s) are uncorrelated, i.e. EXn{t)en{s) = for all < t, s < 1. 

Under assumption 12.11 one can even have long-range dependence among the observations. 
However, in this paper we are only interested in weakly dependent sequences which is stated 
in the next assumption: 

Assumption 2.4. We assume that 

J2 (e [\x^it) - X^'\t)Y dt) ' <oo (2.3) 



l<fc<oo 



and 

with 
and 



[E (e„,(t)-e(^)(t)) dt] <oo (2.4) 



l<fc<oo 



xW(t) = a(77„(t), r7„„i(t), . . . , r7„-fc+i ryi'L^l^)- ^Lfc^i • • • ) 



^^n\t) = KVuit), Vn^lit), na-k+l{t), ^Lfcl*), ^L/c-ll^), 

where {tj^'^I, —00 < k,i,n < 00} are iid copies of tJq. 
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We note that, due to stationarity required by Assumption 12.11 it is enough to assume that 
(12. 3 p and (12. 4p hold for at least one n. Hormann and Kokoszka (2010) call the processes satis- 
fying Assumption 12.41 L^-fc-decomposable processes. This property appeared first in Ibragimov 
(1962) and is used several times in Billingsley (1968) in case of random variables on the line. 
Aue et al (2009) use an analogue of Assumption 12.41 for random vectors when they derive 
tests to detect a change in the covariance structure of the observations. Wied at al (2011) 
investigate the change in the correlation under the same assumptions as in Aue at al (2009). 
Aue et al (2011) provide several examples when Assumptions 12. l l and 12.41 hold. For example, 
autoregressive, moving- average, linear processes in Hilbert spaces satisfy this condition. Also, 
the non-linear functional ARCH(l) model (cf. Hormann et al (2012)) and bilinear models (cf. 
Hormann and Kokoszka (2010) also satisfy Assumption 12.41 

Our next assumption ensures that the p and q largest eigenvalues of C and respectively, 
are unique. 

Assumption 2.5. 

Al > A2 > ■ ■ • > Ap+i 

and 

Tl> T2> ■ ■ ■ > r„+i. 



Assumption 2.6. 



[ [ '^^{s,t)dtds < 00. 
Jo Jo 



We note that under Assumptions 12.21 and 12 . 61 we also have that EYn{t) = and EY^{t)dt < 
00. Let 

= vec ({7£(^, j)> ^ < i < qA < 3 < pV) , 



where 
and 

Define S as 



00 

Uiis) = ^ iJi^rVris), l<i<q. 
r=p+l 



1=1 1=1 

We now define our detector as 

where VAr(t) is defined in (11.91) and S^v is an estimator (up to random signs) for S. The 
Bartlett-type estimator that we propose for S^r is a function of the estimators %,Ar(t) and 
Wi^N{t), which are estimators for v{t) and w{t) up to random signs. For this reason, we cannot 
expect that Sat will be close to S. The best we can expect is that (^j^TInCn "^i^^ be close to 
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S, where is a matrix corresponding to the random signs, Cj^n and c/j ^r. This is described 
in assumption 12.71 

Next we introduce the diagonal matrices Cat and Djv which consists of the random signs, i.e. 
Cn = diag(ci,Ar, . . . , Cp,Ar), Dat = diag((ii,Ar, . . . , dg^N) and = D^r (g) Cat. 

Assumption 2.7. Sa^ = Cn'^nCn ^'^ estimator for S such that 



Opil) 



Note in particular that 

CnIi = vec ({cj^Ndi^Nltii,]), 1 < « < g, 1 < j < vY^ ■ 

Note also that Assumption 12.71 and the continuous mapping theorem combined imply that 
'^N = Cn'^n Cn ^ ^ 

Although any estimator satisfying Assumption 12.71 can be used, we recommend using a 
Bartlett-type estimator as Sat, which we will describe in section [3l 

Theorem 2.1. If Assumptions 71 hold, then we have 

v^{t)^Y.^\{t), 

where {B£{t),£ = 1, . . . ,pq} are iid standard Brownian bridges. 

The testing procedure can be based on Theorem 12. 1^ using functionals of V]\]{t). The dis- 
tribution of functionals of the limit was considered by Kiefer (1959) who provided formulae 
for the distribution functions of the supremum and functionals of the limit. For tables, 
approximations and further discussion on the distribution of functionals of the limit we refer 
to Aue et al (2009). 



3 Bartlett-type estimators 

In this section we discuss the estimation of the long-run covariance matrix of the sums of 
weakly dependent vectors. We start with estimators based on the sequence 7£, 1 < ^ < A. 
Since S is the spectral density at 0, the kernel- type estimators discussed in Grenander and 
Rosenblatt (1957), Anderson (1971), Brillinger (1975), Priestley (1981) and Rosenblatt (1985) 
can be used. The estimator is defined by 

N-l 
k=-{N-l) 

where 

^ mm(7V,Ar-A:) 

4'k,N = ^ inJ+k- 

£=max(l,l-fc) 

The kernel K satisfies the following condition: 
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Assumption 3.1. 

i^) KiO) = 1 

(u) K is a symmetric, Lipschitz function 
{Hi) K has a hounded support 

{iv) K, the Fourier transform of K, is also Lipschitz and integrahle 

These conditions are mild, and they are satisfied by the most commonly used kernels, like the 
triangle of Bartlett and the polynomial kernel of Parzen (1961, 1967). Assumption I3.1( iii) 
makes the present proofs relatively technically simple and it could be replaced with the as- 
sumption that K{x) decays sufficiently fast as |x| — )■ oo. The next assumption is standard in 
the estimation of spectral densities and long term variances and covariances. 

Assumption 3.2. 

i?jv — ^ c>o and B^/N — > 0, as N ^ oo. 

Jansson (2002) proved the consistency of covariance estimation for linear processes under the 
assumption Bj\f = o^N^^"^). Similarly, Hormann and Kokoszka (2010) obtained consistency 
results for the estimation of the long run covariance matrices of the projections of functional 
observations assuming Bj\f = o{N^^'^). Liu and Wu (2010) established consistency results for 
estimation of spectral densities under Assumption 13. 2[ 

Theorem 3.1. // Assumptions \KM^ IKU EH] and\EIE hold, then 

Sat — > S. 

We would like to point out that the proof of Theorem 13.11 only requires that 7^ is a Bernoulli 
shift with zero mean and finite second moment for which (I5.13p holds. 

The estimator, Tin, cannot be computed since the variables 7^ are not observed directly and 
we need to estimate them from the sample. We have estimators for Vj as well as for Wi, but 
we will also need an estimator for e^. We use the residuals to get inference on ef. 

q p 

i=i j=i 

where ipi^j is the {i,j) element of when it is written in the matrix form, i.e. {ipij, 1 < 
^ < ^7, 1 < J < = vec^^(^^). Now 7^ will be replaced with 

7f = vec {{^e{i,j), I <i <q,l < j < p}^) , 

where 

Now the Bartlett-type estimator is defined as 

N-l 

tN= Yl K{k/BN)k,N, (3.1) 

k=-{N-l) 
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where 

^ min{N,N-k) 
£=max{l,l-k) 

The next resuh states that the proposed estimator satisfies Assumption 12.71 
Theorem 3.2. If AssumptionslMJMMlEII\hold and 

Bn^oo and Bn/N^'"^ 0, (3.2) 
then Assumption \2. 71 is satisfied. 

The estimator S^r is based on the empirical projections ^e{i,j) which will be replaced with 
di,NCj^N'y£{h j) in the proof. The rates in flS.Sp and fl5.6p in Theorem 15.21 are optimal so we 
have assumption B^/N^/"^ — )■ in fl3.2p instead of the optimal Bj^f/N — )■ 0. 

4 A simulation study 

In this section, we investigate the empirical size and power of a testing procedure using the 
integral of the detector, J \ VN{t)\dt, as our test statistic. Seeking to obtain a test of size 
a = .01, .05, or .10, a rejection region was chosen according to the limiting distribution of 
the test statistic. Simulated data was then used to compute the outcome of the test statistic. 
Iterating this procedure 10,000 times, we kept track of the proportion of times that the outcome 
fell in the predetermined rejection region. When simulations are done under Hq, this gives 
us the empirical size of the test, which we expect to be close to the nominal size, a, for large 
sample sizes. When simulations are done under the alternative. Ha, the proportion gives us 
the empirical power of the test. 

The X„(t)'s and £„(t)'s were generated according to the distribution of independent standard 
Brownian bridges. Then, using 'ip{s,t) = e^*^*"*) , we obtained the first half of our sample 
according to f ll.ip . The second half of the sample was also obtained from f ll.ip but used 
ip{s,t) = ce-('-*)'. Thus the power of the test is a function of the parameter c. In particular, 
when c = 1, the null hypothesis is true. The Bartlett estimator for E uses the fiat-top kernel 

( 1 < |t| < .1 

K{t) = < 1.1 - \t\ .1 < \t\ < 1.1 
i |t| > 1.1. 

The resulting empirical size and power are given in Tables [T] - H] for various values of p and q. 

5 Random Processes in Hilbert Spaces 

In this section we summarize some basic results on random variables in Hilbert spaces which 
are used in the proofs. Let || ■ || denote the L^-norm of functions defined on the unit interval, 
the unit square or the unit cube. 
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Table 1: Empirical power of test (in %) using p = 1, q = 1, = N^^^/A, and a flat-top 
kernel for K{t) 



c 


= 100 


= 500 


A^ = 1000 


a = .01 


a = .05 


a = .10 


a = .01 


a = .05 


a = .10 


a = .01 


a = .05 


a = .10 


1.0 


0.8 


5 


10.2 


0.9 


5.1 


10 


1.1 


5.1 


10.2 


1.2 


2.5 


10.1 


18 


15.1 


34.9 


46.9 


35.8 


60.1 


71.7 


1.4 


8.9 


26.5 


38.9 


70.5 


88.5 


93.3 


96.9 


99.4 


99.8 


1.6 


24.1 


52.2 


65.5 


98 


99.7 


99.9 


100 


100 


100 


1.8 


46.5 


75.1 


85.1 


100 


100 


100 


100 


100 


100 


2.0 


69.7 


90.7 


95.3 


100 


100 


100 


100 


100 


100 



Table 2: Empirical power of test (in %) using p = 1, q = 2, = N^^^/A, and a flat-top 
kernel for K{t) 



c 


A^ = 100 


N = 500 


A^ = 1000 


a = .01 


a = .05 


a = .10 


a = .01 


a = .05 


a = .10 


a = .01 


a = .05 


a = .10 


1.0 


0.6 


4.5 


9.4 


1 


5.1 


10.4 


1.1 


5.3 


10.3 


1.2 


1.5 


7.9 


15.8 


10.1 


26.7 


38.7 


25.9 


50.2 


63 


1.4 


5.7 


19.5 


30.9 


58 


80.9 


88.6 


93.6 


98.5 


99.4 


1.6 


15.3 


40.5 


55.2 


95.8 


99.2 


99.6 


100 


100 


100 


1.8 


35 


65.4 


78.2 


100 


100 


100 


100 


100 


100 


2.0 


56.6 


83.6 


91.6 


100 


100 


100 


100 


100 


100 



Table 3: Empirical power of test (in %) using p = 1, q = 3, Bj^ = A^^/^/4, and a flat-top 
kernel for K{t) 



c 


A^ = 100 


A^ = 500 


A^ = 1000 


a = .01 


a = .05 


a = .10 


a = .01 


a = .05 


a = .10 


a = .01 


a = .05 


a = .10 


1.0 


0.7 


4.4 


9.6 


0.7 


5.3 


10.2 


0.8 


5.1 


10.2 


1.2 


1.4 


9.5 


17.5 


18.8 


41.8 


54.8 


50 


74.2 


83.5 


1.4 


7.9 


27.9 


42.3 


87.8 


96.9 


98.5 


99.8 


100 


100 


1.6 


24.9 


57.2 


72.1 


99.9 


100 


100 


100 


100 


100 


1.8 


53.2 


82.7 


90.8 


100 


100 


100 


100 


100 


100 


2.0 


76 


94.6 


97.8 


100 


100 


100 


100 


100 


100 



Theorem 5.1. // Assumptions \2J\ 2.4 hold, then we have 



1 ^ 



n=l 



Op(l), 



(5.1) 



1 ^ 

J2(Xnmnis)-Cit,s)) 



n=l 



Op(l), 



(5.2) 
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Table 4: Empirical power of test (in %) using p = 2, q = 2, = N^^^/A, and a flat-top 
kernel for K{t) 



c 


= 100 


= 500 


A^ = 1000 


a = .01 


a = .05 


a = .10 


a = .01 


a = .05 


a = .10 


a = .01 


a = .05 


a = .10 


1.0 


1.4 


5.9 


10.7 


0.9 


4.8 


9.6 


1 


4.9 


10 


1.2 


2.1 


8 


14.1 


7.6 


20.8 


31.2 


19 


39.8 


52.7 


1.4 


4.9 


15.5 


25.4 


45.8 


70.2 


80.5 


88 


96.5 


98.4 


1.6 


11.1 


29.9 


43.4 


90.4 


97.6 


98.9 


100 


100 


100 


1.8 


23.3 


48.8 


62.6 


99.7 


100 


100 


100 


100 


100 


2.0 


38.6 


68 


80.6 


100 


100 


100 


100 


100 


100 



A^V 



1 ^ 



Fit,s))) 



Op(l] 



(5.3) 



n=l 



with F(t,s) = £'(e„(t)e„(s)). If in addition Assumption \2.6i is also satisfied, then 



1 ^ 

J2(Y^{t)Y4s)-D{t,s)) 



n=l 



Op(l). 



(5.4) 



Proof. It was pointed out in Hormann and Kokoszka (2010) that the fc-approximable property 
in Assumption 12.41 implies (15. 2p and (15. 3p . Using (11. ip . we get that the sums of X„(t)e„,(s) 
and Yn{t)Yn{s) are also fc-approximable so the rest of the result again follows from Theorem 
3.1 of Hormann and Kokoszka (2010). □ 



Theorem 5.2. // Assumptions IK1\\2. 61 hold, then we have 



max ||wi,Ar(t) - di^NWi 

l<i<q 

max \\vj,N{t) — Cj^NVj 
i<i<p 



Op {N~'/^) 
Op (Ar-V2) 



and 



max \ fiN — Ti\ = Op (N ^^'^) 

l<i<g ^ ' 



max 

i<i<'7 



|A,,^_A,| = Op (Ar-V2) 



(5.5) 
(5.6) 

(5.7) 
(5.8) 



Proof. Using Corollary 1.6 of Gohberg et al (1990, p. 99) we get that (15. 5p follows from ( 15. 4p . 
According to Lemma 4.3 of Bosq (2000), (15. 4p implies ( 15. 7p . Similarly, (15.20 yields (15. 6p and 
dEl]). □ 

The next result is a uniform version of Theorem 15.11 

Theorem 5.3. If Assumptions lK1^2.4\ and \2.6[ hold, then we have 

k 



max 

l<A;<Ar 



n=l 



Op(logAr), 



(5.9) 
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max 

l<A:<Ar 



max 

l<fc<Ar 



k 

i^^(X„(t)X„(s)-C7(t,s)) 



ATI/ 



n=l 
k 



^X^(en(t)e„(s)-F(t,s))) 



n=l 



Op(logiV), 



Op(logiV) 



(5.10) 
(5.11) 



with F{t,s) = i?(e„,(t)e„(s)). If in addition Assumption \2.6[ is also satisfied, then 



max 

l<fc<Af 



k 

^^(y„(t)r„(s)-z}(t,.)) 



Ari/2 



n=l 



Op(logiV). 



(5.12) 



Proof. Following the proof in Section A.l in Hormann and Kokoszka (2010) one can easily 
verify that there is an integrable function g{t, s) such that 

E (^^Xn{t)en{s)j <kg{t,s). 
Hence by Menshov's inequality (cf. Moricz (1976)) we have that 

E max f Vx„(t)e„(s) I < {\ogNyNg{t, s), 



implying (15.91) . Similar arguments yield fl5.10l) - (l5.12p . 

The next results establish the weak convergence of the sum of the 7^'s. 

Theorem 5.4. If Assumptionsl2J^2.4\ and\2.6\ hold, then 



□ 



1 vpi[o,i] 
T/2 Z^^i ^ 



iVV2 



Ws(t), 



where Ws is a pq dimensional Brownian motion with zero mean and -E'(Wx;(t)Wx;(s)"^) 
min(t, s)S. 



Proof. First we note that Assumptions 12.1112.41 imply that 

1/2 



(5.13) 



m=l 



where 7^(i) and 7£™''(«) are the i^^ coordinates of the vectors 7^ and 7^™'' with 



7f ^ = vec({7r(^, j), 1 < ^ < g, 1 < J < pV), 



(m) 



and 



7f)(.,j) = (Xf + {Xl-\v,){xi-\u.). 
The result now follows immediately from Theorem A.l of Aue et al (2009). 



□ 
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6 Proof of Theorem 12.1 



First we outline the proof of Theorem 12.11 Using the definition of the residual vectors we can 
write that 



V^(t) = ((Zf^.j Yl^.j - Zf^,jZL;v*j^;v) - t (zlY^ - Z^Z^^^)) (6.1^ 



with 



( A(l) \ 
A(2) 



We show that 



[p-hn)^ =0p(\) 
(cf. Lemma [6.1Up and we prove in Lemma [6.21 that 



sup 

tG[0,l] 



N 



N 



op {I). 



Combining (16. 2p and (16. 3 P we conclude that 



sup 

tG[0,l] 



N 



f3-(3 



N 



op {I) 



(6.2) 



(6.3) 



Thus we see that N ^Z^^j A|^7vtj ~ ^Z^A^v^ is the leading term while the remainder can 
be disregarded when considering the limiting distribution of our cumulative sum process (II. 9p . 



We now start with the proof of (16. 3p . 

Lemma 6.1. // Assumptions \2D^2. 51 hold, then we have 

1 ^ 

-'^{Xn,v.^{Xn,Vj) ^ \il{i = j] as k ^ oo. 



n=l 



Proof. We recall that Xn{t) is stationary and ergodic. Thus the ergodic theorem shows us 
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that as /c — ^ oc 



-1 ^ pi pi 

-y^{Xn,Vi){Xn, V,) X4s)v^{s)ds Xr,{t)v ,{t)dt 



completing the proof. 



E [ V,{t) [ V^{s)Xn{t)Xn{s)dsdt 

Jo Jo 

Vj{t) [ Vi{s)E{Xn{t)XrXs))dsdt 
Jo 

1 .1 

Vj{t) i Vi{s)C{s,t)dsdt 



Vj{t)XiVi{t)dt 



Lemma 6.2. If Assumptions [KT^2. 51 hold, then we have 



te[o,i] 



Op(l) 



and 



— Z^Zat 



C = ® A, 



where A = diag{Xi, X2, . . . , Xp). 

Proof. First we show that for 6 > and 7 > there are Kq and No such that 

P( sup y V'(X„,t;i,Ar)(X„,%,Ar) - Ail{i = j} > (5 )< 7, 
\Ko<k<N ^ / 

if > A'^o- Note that by the Cauchy-Schwarz inequahty we have 



1 



?i=l 



1 



n=l 



Using the ergodic theorem we get that 



1 

sup — ^^||X„|p<oo a.s. 



l</c<oo 



n=l 
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so (16. 6 P follows from Theorem 15.21 and Lemma 16.11 



Assume N > Nn. It now follows that 



P I sup 

te[o,i] 



Z lNt\ Z [Nt\ 



> 4:N6 



( 



< P I sup 

\0<t<Ko/N 

< P I sup 

< P I sup 

0<t<Ko/N 



N 



< P I max 

l<k<Ko 



N 

-^oZ^^Zjv 



+ sup 

Xo/Af<t<l 



sup 

Ko/N<t<l 



+ sup 

Xo/Af<t<l 



ZfArtjZ[ArtJ — tZTrZ 



'LiViJ^LTViJ Z^Z 



N 



Nt 
Nt 



N 



> 4:N6 



> 46 



+ max 

Ko<k<N 



k 



-c 



+ 



c 



ZjvZat 

N 



Z^Z^r 



N 



C 



> 46 



- C 



> 46 



For every Kq we have that P(maxi<fc<;^o |Z^Zfc|/iV > 5) ^ and by (JHS]) P{\KoZ%Zn\/ N"^ > 
5) — )■ as — )■ oo. Using (16. 6 p again we conclude P(maxi4'g<fc<Ar |Z^Zfc/A; — C| > 6) < 7. 
Since 7 and 5 can be chosen as small as we wish, Lemma 16.21 is established. 



□ 



We continue with the properties of Z7"^ri , A 1 1 . First we observe that 



[Nt] 
[Nt\ 

E vec {{{X(,,Vj^N){4*^ ^i,N), I <i < qA < j < p}^) ■ 



(6.7) 



We note that 



15 



with 



oo oo „i oo oo 

i=q+l j=l i=q+l j=l 

q oo „i q oo 

Vn,2i't) = Yl Yl ^^Mt) / Vj{s)Xn{s)ds = J2 Yl A,3Wi{t){Vj,Xr,), 

i=l j=p+l i=l j=p+l 

^n,3(^) X] X] di,Nll'i,jCj^Ndi,NWi{t) / (Cj, 7vVj(s) - %jv(s)) ^n(s)o?S 

i=l ,=1 -^0 



q p 



i=l j=l 

?7n,4(i) = di,NA,jCj^N [di^NWi{t) - Wi,iv(^) ) / Cj^NVj{s)X„{s)d6 

i=l 3=1 ^ ' 

= y y dj^NlpijCj^N idi^NWi{t) - Wi^N{t)) {Cj^NVj,Xn), 



i=l j=l 

VnA^) = X] X] di,Ni'i,jCj^N (wi^N{t) - di^NWi{t)j j {Cj,NVj{s) - Vj,N{s)) Xn{s)ds 
i=l j=l "'O 

q p 

= X] X] di,Nlpi,jCj^N (wi^N{t) - di^NWi{t)^ {{Cj,NVj - Vj^n) , X^) ■ 
i=l j=l 

In particular, we can write 

/ ^ K , ^ \ , \ (6-8) 

We show that Z"^jjA|^7vtj can be written as the sum of weakly dependent variables and an 
additional term which is just t times a random variable matrix. The additional term reflects 
the replacement of ^ with a finite sum and the estimation of the eigenf unctions {wi,l < i < q} 
and {vj, 1 < i < p}- The drift term is given by 

Rat = vec {{RN{i,j), l<i<q,l<j < p}^) , 
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where 



r=q+l 
1 



n=p+l 



P pi 

Rpihj) = Cj,Ndi,N>^j y2 ^hnCn,N / {Cn,NVn{s) - Vn,N{s)) Vj{s)ds, 

n=l 

R^Nihi) = Cj^Ndi,N>^j ^ dr,NA,j / Wi{x) (dr,NWr{x) - Wr,N{x)] dx. 

r=l 



Lemma 6.3. If Assumptions [KT^2. 51 hold, then we have 



sup 

te[o,i] 



Op (logiV) 



where 



[Nt] 



Proof. We note that 



sup 

te[o,i] 



im iNt\ 

'^{Xi,Vj^N){ee,Wi^N) - ^{Xe, Cj^NVj) {ee, di^NWi) 



< sup 

ie[o,i] 



[Nt\ 

e=i 



+ sup 

te[o,i] 



y^^{Xi, Cj^NVj) {ej, Wj^N - di,NWi) 



1=1 



Using the Cauchy-Schwarz inequahty we get that 



sup 

<e[o,i] 



[Nt\ 



£=1 



< sup 
te[o,i] 



[Nt\ 



Y,X,{x)e,{s) 



\Vj,N - Cj^NVj\\\\^i,N\\) 



= 0p (logiV), 

on account of (15.6p . Theorem 15.31 and ||t&t,Ar|| = 1- Similar arguments give that 



sup 

iG[0,l] 



\_Nt\ 

^(-^^ Cj,NVj){ei, Wi^N - di,NU)i) 

e=i 



Op (logiV) 



completing the proof of the lemma. 
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Lemma 6.4. If Assumptions [KT^2. 61 hold, then we have 



sup 

t6[0,l] 



^{Xe,Vj^N){ve,i,Wi,N) - lNt\R'^^\i, j) 



Op (logiV). 



Proof. Using the orthogonality of the Wj's we get that 



Vn{s)X£{s)ds > Wi{x)dx 



Jo r-=g+ln=l l^-^O 

oo oo „i / /"l 

^^V'r.n / Vn{s)Xi{s)ds ( / Wi{x)Wr{x)dx 



r=q+l 

= 0. 

Therefore we have 
Now, 



e=i 



where 



1 fl rl 




oo oo 



Jo Jo 



Yi^r,nWr{x)Vn{s) {Wi^N{x) - di^NWi{x) 
r=q+l n=l 



Yx^{z)X^{s) - [Nt\C{z,s) dzdsdx 



and 



1=1 



1 /.I /.I 




oo oo 



'0 ^0 ^0 

,1 oo 



'Y^'4^r,nWr{x)Vn{s) \ Wi,N{x) — di^NWi{x) ) C{z, s)dzdsdx 
r=q+l n=l 

JO r=q+l 

= [Nt\R^j!,\t,j), 
where we used that the f^'s are orthonormal eigenf unctions of C. 



Applying again (15. 5p and flS.lOp we conclude 



sup 

tG[0,l] 



.(1) 



Op (log AT). 
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Finally, using Theorems 15.21 and 15. 3[ we obtain that 



sup 

tG[0,l] 



{Xi, Vj^N - Cj^NVj) (?7<?,l, Wi^N - di,NWi) 



oo oo 



r=q+l n=l 



X sup 

te[o,i] 



Op {N-^l^) 0{l)Op {N-^'^) Op (N) . 



Lemma 6.5. If Assumptions \2D\2. 61 hold, then we have 



□ 



sup 

te[o,i] 



\_Nt\ 



{Xi, Vj^n) {m,2, W^^N) - (cj^Ndi,NTl^m\ j) + L^^J ^!v^ j) 



Op (logiV) 



where 



L^*J pi pi oo 

'^lNt\i^^j) = ^ / / {Xe{s)Xe{z) - C{z,s)) ^ iJirVr{s)vj{z)dzds. 

1=1 "'0 "'O r=p+l 



Proof. First we write 



J2{Xi,Vj,N){Vi,2,Wi,N) = Af^ti + + + A 



(6) 

[Nt]-- 



where 



^L^tJ = Cj^Ndi,N ^ {Xi, Vj) (r7£,2, Wi) , 



^=l 



4(4) _ ^ 



Y. 

£=1 

[Nt\ 



^{Xi,Vj){r]e^2,Wi^N - di,NWi), 



^L^tj = di,N^{Xi, Vj^N - Cj^NVj){'ne,2^ Wi), 



i=i 



[Nt\ 



e=i 



The orthonormality of {wi, 1 < i < 00} shows that for all 1 < i < g 



/ ^ ^ 'ipr,nWr{x) < / Vn{s)Xi,{s)ds I Wi{x)dx 
Jo r=ln=p+l ^-^0 ) 

00 „i 



Vn{s)Xi>{s)ds. 
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Therefore, using again that the Vj''s are orthonormal eigenfunctions of C we have 

^fm == Cj,Ndi,N ^i,n / / Vj{z)vn{s) ^X^{z)X(,{s) - [Nt\C{s,z) dsdz 

n=p+l Jo Jo / 



=p+l 

lNt\ 

We decompose Ajt^., as 



[Nt\ ^.^ q oo 



Xe{z)Vj{z) flt''i,jv(x) -di,NWi{x)) ^ ^ ljjr,nWr{x 
1=1 - - r=l n=p+l 

X / Vn{s)Xf(s)dsdzdx 
Jo 

/ ^ g oo 

- - - ^ r=l n=p+l 



1 /■! ^ g oo 

Ci,iV / / / Vj{z) [Wi^N{x) - di,N'Wi{x))y^^ y2 ll'r,nWr{x)Vn{s) 

p+1 

X X^(s)X^(2;)cisci2;cix 



where 



4(4) , 4(4) 



ml g oo 

Vj{z) (wi^N{x) - di^NWiixU y2 '^r,nWr{x)Vn{s) 
^ ^ r=l n=p+l 

J2^e{s)Xe{z) - lNt\C{s,z) dsdzdx 



X 



and 

-1 /.I ,.1 



^[tJtJ,2 = 9,ivL^tJ i i i Vj{z)(wi^N{x)-di,NWi{x)^ 



'0 JO Jo 

q oo 

X 1pr^nWr{x)Vn{s)C{s^ z)dsdzdx 

r=l n=p+l 

,1 „1 ij oo 



= Cj,ArLiVtJ j J XjVj{s) (wi^N{x) - di,NWi{x)^^ ^ ^r,nWr(a;)vn(s)(is(ia; 
= 0, 



r=l n=p+l 
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using again that the fj's are eigenfunctions of C. Therefore we obtain 



sup 

te[o,i] 



A 



(4) 



sup 

te[o,i] 



A 



(4) 



< 



lNt\,l 



q oo 



E E * 

r=l n=p+l 



X sup 

te[o,i] 



J2Ms)Xi{z)-[Nt\Cis, 

1=1 

Op {N~^l^) Op (1) Op log A^) . 



Similar arguments give 



q oo 



Jo Jo n=p+l 



i=l 
"1 



X / Vn{s)Xe(s)dsdzdx 
Jo 

(5) , 4(5) 



where 



4(5) - i 



1 /.I 




^0 



n=p+l 



X 



- [Nt\C{s,z) dsdz 



1=1 



and 



mi 1 °° 

{vj,N{z) - Cj^NVj{z)) Wi{x) ^r.nWr(a;)t;„(s)C(s,2;)(is(iz(ia; 
^ - - r=ln=p+l 



= [Nt\R^i\i,j). 
Repeating our previous arguments we get that 



sup 

te[o,i] 



A 



(5) 



< \\^j,N{z) - Cj,NVj{z)\\ 



00 
n=p+l 



sup 

te[o,i] 



= Op (Ar-V2) 0(l)Op (iV^/^iQgjy) _ 

Similarly, using the Cauchy-Schwarz inequahty with (15.21) and Theorem 15.2^ we conclude that 



sup|Af^,j|Op(l), 



te[o,i] 



completing the proof of the lemma. 



□ 
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Lemma 6.6. If Assumptions [KT^2. 61 hold, then we have 



sup 

t6[0,l] 



^(X£,{)j-jv)(%3>i,iv) - [Nt\R^^\iJ) 



Op (logiV). 



Proof. We write 



i=i 



where 



[Nt\ 



[Nt\ 



Theorems 15.11 and 15.21 imply that 



sup 

te[o,i] 



.(7) 



sup 

te[o,i] 



1=1 r=l n=l 



,nCn,NWr[X) 



X / {Cn,NVn{s) - Vn,N{s))Xt{s)dsdzdx 





<? P 

^ 5Z 5Z ^^p 



r=l 



n=i *e[o,i] 



X \\Wi^N{,x)i)r,nCn,NWr{x)\\ || C„,Ari;„ (s) - i)„,Ar(s) 

Op (A^) Op 0(l)Op , 



and similarly 



sup 

te[o,i] 



.(8) 



Op {I) 



Next we observe that 



sup 

te[o,i] 



.(9) 



4(9) I 4(9) 



where 



\jVj{s)Wi{x) ^ ^ V'r,nC„,ArWr.(x) (c„,Arf„(s) - {)n,Ar(s)) dsdx 
- - r=l n=l 

[Nt\Rf{l,3) 



q p 
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and 



Vj{z)Wi{x) 



q p 



X ^ ^ '4jr,nCn,NWr{x) {Cn,NVn{s) - Vn,N{s)) dsdzdx. 
r=l n=l 

Using Theorems 15.21 and 15.31 again, we obtain that 



sup \A 

te[o,i] 



(9) I 
[Nt\,2\ 



Op (logiV). 



This completes the proof. 

Lemma 6.7. // Assumptions l2n\\2. 61 hold, then we have 



sup 

te[o,i] 



{Xe, Vj^n) {ViA, ^i,Af) 



Op (logiV). 



Proof. Following the proofs of the previous lemmas we write 



(13) 



where 



1=1 

= Cj,Ndi,N^{Xi, Vj){r](.^i,Wi), 



[Nt\ 



^[Nti = ^i.^ ^i) (^^'4, Wi^N - di,NWi). 



1=1 



Repeating the arguments used in the proofs of Lemmas 16.41 and 16. 5[ one can show that 



Elementary arguments give 



sup 

te[o,i] 


.(10) 

^[Nt] 


= Op(l), 


sup 

te[o,i] 


.(12) 


= Op{l), 


sup 

te[o,i] 


.(13) 


= Op{l). 




.(11) , .(11) 
^lNti,l ^ ^[Nt},2 
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where 



.1 rl rl fl^^i 



1,nJ^ / / \^^Mz)Ms)-[Nt\C{z,s)jvj{z)wi{x) 

dr,Ni'r,nCn,N f rf^.TV^r (x) - Wr.Ar(x) j Cn,NVn{s)dsdzdx, 



and 



r=l 



= [Nt\R^^{i,j). 
Using Theorems 15.21 and 15.31 again, we conclude that 



sup 

te[o,i] 



A 



(11) 

\_Nt\ ,2 



Op (logiV) 



completing the proof. 

Lemma 6.8. If Assumptions [KT^2. 51 hold, then we have 



sup 

te[o,i] 



Op (1) . 



Proof. It follows from Theorems 15.11 and 15.21 that 



sup 

t&[o,i] 



sup 

te[o,i] 



L^*J rl rl 




q p 



JO 



Xe{z)Vj^N{z)Wi^N{x)^^dr,NA,nCn,N (u!r,N{x) - dr,NWr{x) 
r=l n=l 







X / {Cn,NVn{s) - Vn,N{s)) Xi{s)dsdzdx 

Wi^N{x)\\ ||%,Af(-2)|| Wr,N{x) — dr^N^rix) 



q p 

<EEi* 



r=l n=l 



sup 

ie[o,i] 



[Nt\ 

e=i 



X \\Cn,NVn{s) - Vn,N{s)\\ 

Op (N) Op {N~'/')Op (iV-V2)_ 
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Lemma 6.9. If Assumptions [KT^2. 61 hold, then we have 



sup 

iG[0,l] 



im I ^ yNt\ 

\ 



=1 \ e=i 

Proof. Combining Lemmas 16.31 - ISTKj we immediately see that 



Op (logiV) 



sup 

*6[0,1] 



{Xe, Vj.n) (ef, Wi,N) - ( [Nt\ RN{i, j) + Cj^Ndi,NTim\ {h j) 



Op (logiV) 



where 



TiNt\ {i, j) = T^Nti {i, j) + T^'J^^ {i, ]] 
Thus we need only to show that 



.(2) 



However, using that the f,'s are orthogonal eigenfunctions of C, we get that 



1 rl 



C{z,s)vj{z) 



oo «i oo 

1pi^rVr{s)dsdz = Xj / Vj{s) 

, 1 ' Jo , 



1pi,rVr{s)dsdz = 0, 



r=p+l 



'0 ^0 

completing the proof. 

Lemma 6.10. // Assumptions [KT\\2. 61 hold, then we have 

y/N{f3-^^)\=0p{l) 

Proof. It is easy to see that 

v^(/3-/3,) = -iV-/^f^ 



r=p+l 



It follows from fl6.5D that 





-1 


V ^ J 





Lemma 16.91 and (16. 7p yield that 
Z^Aat 



- ^ ^ N\RN{i,j] 



Op(l). 



N 



+ 0p (log AT) 



It follows from Theorem 15.21 that for all 1 < i < g, 1 < j < p 

N\Rn{i,j)\=Op (iVV2) 
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while Theorem 15.41 implies that 



N 



Op . 



□ 



Lemma 6.11. If Assumptions [KT^2. 61 hold, then we have 



sup 

ie[o,i] 



V 



N 



1 A'^*^ 

\i=l 



N 



It 



op (11 



Proof. Lemmas 16.21 and I6.1UI and f l6.ip imply that 

1 



sup 

te[o,i] 



V^(t) - 

It also follows from Lemma 16.91 and (16. 7p 



Op(l) 



sup 

*G[0,1] 



Op (logiV) 



□ 



and therefore the proof is complete. 
Now we have all the necessary tools to prove the main result. 
Proof of Theorem 12.11 It follows from Lemma 16.111 and Theorem 15.41 that 

CivVTvW ''^'^ Ws(t)-tWs(l). 

Next we observe that 

|s"i/2(Ws(t) - tWs(l)), < t < l} = {B{t), < t < 1}, 

where Bit) = {Bi{t), . . . Bpq{t))^ and Bi, . . . Bpq are independent, identically distributed Brow- 
nian bridges. Hence 



pq 



Now, using Assumption 12.71 with Slutsky's lemma, the proof is complete. 



□ 
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7 Proof of Theorems 13.11 and 13.2 



We can assume without loss of generality that K{u) = if |m| > 1. Let m be a positive integer 
and define 

7^^ = vec({7f ^(^, j), 1 < . < g, 1 < J < pV), 

where 

The long term covariance matrix associated with the stationary sequence {7^™'', 1 < £ < 00} 
is given by 

00 00 

1=1 1=1 
The corresponding Bartlett estimator is defined as 



N-l 

(m) _ \^ 1^ \aSt<A 



fc=-(Ar-l) 



min(Af,Af-fe) 



where 

min(Af,Ar-fc) 

iV 

£=max(l,l— fc) 

are the sample covariances of lag k. Since K is symmetric, -ft'(O) = 1 and K[u) = outside 
[—1,1] we have that 

fc=l fe=l 

for all sufficiently large N. 

We start with the consistency of S j^"* . 

Lemma 7.1. // Assumptions ISAl and \3.2 are satisfied, then we have for every m 

~{m) V 

as N ^ 00. 

Proof. Since the sequence 7^'"'' is m-dependent we have that 

m m 

e=i e=i 
It follows from the ergodic theorem that for any fixed k and m 

(Pk,N ^ l7l+fcJ • 
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So using Assumptions 13.1 (1). I3.1( ii) and 13.21 we get that 

mm mm 

k=l k=l 1=1 1=1 

Lemma 17.11 is proven if we show that 



X: K{k/B^)4>^-1 A (7.1) 



Bn 



, (m) V 

k=m+l 

and 

J2 K{k/BMt^r^Q. (7.2) 

fe=m+l 

Clearly, it is enough to prove (17. ip . 
Let 

k=m+l 

Elementary arguments show that 

Bn 

= E K{k/B^)ct>^-}, 

k=m+l 

Bn ^ N-k 

m+l 
Af-(m+l) 

E (m)-rTM 

=1 



where 



Let 



ttM _ \^ K[k/BN) f(m)Y 

k=m+l 

N-{m+l) 

i=\ 

where 7£™'''(i) and H^"^{j) are the and the j^^ coordinates of the vectors and H^*^, 
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respectively. Next we write 



'N-(m+l) 



where 



and 



l<r<N-{m+l) 

l<e<N-{m+l) 

l<r<N-{m+l) 
l<e<N-{m+l) 
\r-e\<m 

Gtki. j)- EE ^ {^S uht^ (07^) 0')) ■ 

l<r<N-{m+l) 
l<e<N-{m+l) 
\r-e\>m 



Notice that 7^"'' is independent of H^^, and 'jr"'' , if r > m + £. Hence 



E7^^ m uwr^ mi^i u)) e>m+r, 

E (HtJ{j)7t\^7^"'\^)Hl:J{j)) \i-r\< m, 



Thus we have 



\i — r\ > m, 



Let M be an upper bound on Using the fact that 7^"*^ is an m-dependent sequence, 

we now obtain the following: 



29 



fc=m+l v=m+\ 



N 



(7.3) 



< 



2 min(Ar-£,Bjv) min(Af-^,_Bjv) 



Ar2 



r=— m 

In the next step we will first use the Cauchy-Schwarz inequality, then the independence of 
^ewU) ^"^^ le"\^) the independence of H'f^{j) and '-fr^\i) to get 

l<r<N-{m+l) 
l<e<N-{m+l) 
\r—£\<m 



k=m+l v=m+l 

2 



l<r<Af-(m+l) 
l<^<Af-(m+l) 
\i — l\<m 



1/2 



^ EE (i=(<'o))')''7£^(7r''w)Y''(s(7;"'>(>))0 



1/2 



l<r<Af-(m+l) 
l<^<Af-(m+l) 

r— £1 <m 



B 



1/2 



1/2 \ 



< 2mN0 I ^ I 0(1)0(1)0 



B 



1/2- 



= o{l), 

where we also used ( 17. 3p and Assumption 13.21 This completes the proof of Lemma 17.11 □ 



Let r = -1. 

Lemma 7.2. // Assumptions \2.1\ 2.4, \3.1\ and \3.2\ are satisfied, then for all 1 < j < pq we 

have 



lim sup lim sup sup E 

N^oo m— >-co — oo<t<oo 



(]^E(^^0-)-7r(j))e^") 



0, 



(7.4) 
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and 



lim sup lim sup sup E 

Af— >oo m— >oo — oo<t<oo 



lim sup lim sup sup E 



k=l / 
N \ 2 

k=l / 



Af— >oo m-^oo —oo<t<oo \ N'^/'^ 

Proof. First we note that 

l<k<N 



OO. 



(7.5) 



(7.6) 



+ 2 E\{j,{j)-jt\jWeU)-l^"'\j)) 



l<k<e<N 

It follows from f l5.13p that there is a sequence Ci(m) — )■ such that 



l<k<N 



< Nci{m). 



Next we write 



l<k<i<N 



j{k+e)t 



j(k+e)t 



l<k<i<N 

since (7^,7^™'') and 'yf^'^'' are independent. Using the Cauchy-Schwarz inequality first, then 
(I5.13P again we get that 



E \E\{lk{3)-l^r\3)){l^U)-lt'\3)) 



j{k+e)t 



l<k<i<N 



l<k<e<N 



1/2 



< E \E{ik{j)-it^\j)rr^\EM)-it'\j)r 



1/2 



1/2 



< N [e(7i(j) - E - 

l<fc<oo 

= Nc2{m) 

with some sequence C2(m) — )■ 0. Similar arguments show that 



1/2 



E \E\iik{j)-it\j)hi"'\j) 



j{k+e)t 



l<k<i<N 

with some sequence C3(m) — 0, completing the proof of fl7.4p . 
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Similarly to the proof of fl7.4p . we write 



N 



N N 



\A;=1 / k=l 1=1 

N 

k=l l<k<e<N 
N 

k=l l<k<i<N 

since by the independence of 7fc(j) and '^f~^\j) we have that E'^k{j)'^f^^\j) = 0. Using the 
Cauchy-Schwarz inequality with (15.131) we get that 



i{k+t)t 



l<k<e<N 



< cN 



with some constant c, completing the proof of ( 17. 5p . The same arguments can be used to 
prove (17. 6p . □ 



Following Taniguchi and Kakizawa (2000) we define S]\f{t) — Y2k=i^k,N 

e*^* and 8)7^ (t) 



7fc"^e*'^*. Let S*j^{t) be the conjugate transpose of 8^(1) and introduce 
Iiv(«) = ^S^,{t)SUt) 



k=l £=1 

N N 

EE 



E=l k=l 
N-1 ^ mm{N,N-k) 



k=l-N 
N-l 



^=max(l,l— fc) 



Similarly we define 



A:=l-Ar 



N-l 

E • 

k=l-N 



itkiim) 
^k,N- 



Lemma 7.3. // Assumptions l2J\\2.4l \3.1\ and \3.^ are satisfied, then we have 



lim sup lim sup sup E 

Af— foo m— >oo — oo<i<oo 



0. 
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Proof. By the triangle inequality we have 



1 

< — 



s^(t)(s^(t)-(sjr^(t))* 
(s^.(t)-s!rHt))(s!r)(t))* . 

Now the result follows from Lemma [7.21 via the Cauchy-Schwartz inequality. 



1 



□ 



Proof of Theorem 13.11 Define the Fourier transform, K{u), of the kernel K as K(u) = 
^ K{s)e~^'^'^ds. Since K and K are in and both are Lipschitz functions, the inversion 

formula gives K{s) = K{u)e^^'^du. From the relationship between K and K and from the 
fact that K is supported on the interval [—1, 1], we obtain: 



J2 K{klBN)ct>,, 

=—Bn 
N-l 



k,N 



k=l-N 



k=l-N 
f oo 



oo 
N-l 



k{u) J2 e 

k=l~N 

oo 



Similarly, 



Hence we have 



E 



E 



K{u)In{—u/ BN)du. 

k{u)li;\-u/BN)du. 

X) 

k{u) (In{u/Bm) - l!r^(M/S^) ) du 



< 



k{u) 



E 



In{u/Bm)-1^;^\u/B_ 



N, 



du 



< sup 

— 00<t<CXD 



i;v(t)-i!r^(t) 



Applying Lemma E3] we conclude that 



,(m) 
■'AT 



V 
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as min(A^, m) — )■ oo. On the other hand, by Lemma [7.11 for every fixed m 



~{m) V 



Since 



as m — 7- oo, the proof of the theorem is complete. □ 

Proof of Theorem 13.21 It follows from the definition of q, (II. 4p and the orthonormality of 
{wj, I < j < oo} that 

{ee,Wi) = {ei,Wi) + {Xe,Ui) + (yi,Wi), 

where 

q p q P 

i=l j=l 1=1 j=l 

Following the proof of Theorem 13.11 one can show that the estimates in f lS.Sp and (15. 6 p yield 



where 



and 



with 



T.N{i,j,i',j') - di,NCj,Ndi',NCj',N^%{i,j,i',j') = Op(l), 



(7.7) 



N-l 



k=-{N-l) 



N)(pk,Nii,j,i',j') 



N-l 



k=-{N-l) 



^ min(Af,Af-fc) 

£=max(l,l— fc) 
mm(7V,Af-A;) 

.7 E iKhjhU^',j'), 



N 



and 
Since 



f=max(l,l— fc) 

= {Xe,Vj){ee,Wi). 



{X(>,Vj){ei,Wi) = jeiij) + {Xi,Vj) {ui,Wi) , 
(15. 5p . ( 15. 6 p and Lemma [6. lUI imply that 



Sat — 



Op(l). 



(7.8) 
□ 



We have seen in Theorem 13.11 that 



that 



Y:n-Cn'^*nCn = Op (1) and 



completing the proof. 



Sat — S|^r 



Op(l). In (17. 7p and (17. 8p we have seen 



Op(l). Therefore, 



op(l), 
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